Display apparatus with input function

ABSTRACT

An information display device displays a sub-screen in a main screen and stores display information including the display position of the sub-screen and information on a near-field region. A position input device acquires information on a touched position, stores touch history information including information on a plurality of touched positions acquired, and includes a touched position determination section that determines whether a newly-acquired touched position is present in the near-field region and a display position determination section that, in a case where it has been determined that the newly-acquired touched position is present in the near-field region, utilizes the touch history information to determine a position to which the sub-screen is reduced or moved. In a case where the sub-screen has not been reduced, the sub-screen is reduced to the determined position. In a case where the sub-screen has been reduced, the sub-screen is moved to the determined position.

BACKGROUND 1. Field

The present disclosure relates to display apparatuses with an inputfunction and, in particular, to a display apparatus with an inputfunction that has a multiple-window display function of displaying aplurality of display screens on one display device and makes it possibleto input and display characters or the like by touching a display screenwith a finger, a pen, or the like.

2. Description of the Related Art

Conventionally, an image display technology (picture-in-picturefunction) has been utilized with which to cause a display panel of onedisplay device to simultaneously display a plurality of partlysuperimposed display screens showing different images, respectively. Forexample, one image A is displayed all over a main screen of the displaypanel, and a sub-screen showing another image B is displayed over adisplay region of a part of the image A thus displayed.

Further, a display apparatus with an input function has also beenutilized in which a touch panel serving as a position input device thatdetects a position touched with a pen or a finger and a display screenare placed on top of each other and characters, graphics, or the likeinputted by touch are displayed in a touched position on the displayscreen.

In a case where a user is inputting characters or the like into the mainscreen with a pen in a state where a plurality of display screens aredisplayed on such a display apparatus having a picture-in-picturefunction and including a touch panel, a sub-screen being displayed overa part of the main screen may constitute an obstacle. If the user wouldlike to perform input on a display region in which the sub-screen isbeing displayed, the user has had to perform a series of actions ofdiscontinuing the pen input, performing a predetermined operation tomove or erase the sub-screen so that the region over which thesub-screen was displayed can be seen, and then resuming the pen inputfrom the place where the user discontinued the pen input.

The series of actions that the user performs requires time andtroublesome operations. Therefore, a device has been proposed which, ina case where a coordinate input pen has designated a position within theimage B, which is a sub-screen, automatically makes the sub-screentransparent or semitransparent (see Japanese Unexamined PatentApplication Publication No. 2006-244078).

Further, a device has been proposed which, in a case where a cursor or apointer being displayed on a display screen overlaps in position with asegment in which a sub-screen (sub-window) is present or in a case wherethe distance between the display position of a sub-screen (second image)and the position of a cursor becomes less than a threshold,automatically moves the sub-screen from one display position to another,erases the sub-screen, or makes the sub-screen transparent (see JapaneseUnexamined Patent Application Publication No. 2012-8628 and JapaneseUnexamined Patent Application Publication No. 8-314681).

However, in such a conventional case where a series of troublesomeactions is required, for example, to move a sub-screen, the operation ofinputting characters or the like is discontinued. Therefore, forexample, in a case where a user is making a presentation while addingcharacters or the like to the display content, the user bears a largeburden of operation and cannot smoothly input characters or the like orexplain the display content.

Further, the device that, for example, automatically moves a sub-screenfails to take into account the display position of characters or thelike inputted by touch until then, the locus of a line segment inputtedby touch, or the direction of touch. Therefore, the sub-screen may bemoved to an inappropriate position. Moreover, suddenly moving thesub-screen to another position or making it transparent when the cursor,the pen, or the like overlaps in position with the sub-screen may not beappropriate for a person who is performing the input operation or aperson who is looking at the display screen.

SUMMARY

It is desirable to provide a display apparatus with an input functionthat determines the display size and position of a sub-screen withreference to a history of touched positions inputted in the past andallows a user to more smoothly continue the inputting of characters orthe like while looking at the displayed content.

According to an aspect of the disclosure, there is provided a displayapparatus with an input function, including: a position input devicethrough which to input information on a touched position; and aninformation display device that displays information, the position inputdevice and the information display device being placed on top of eachother, wherein the information display device includes a display panelthat displays a first display screen and displays a second displayscreen in a display region of the first display screen, a first storagesection storing display information including a display position of thesecond display screen and information on a near-field region includingthe second display screen and having a larger region than the seconddisplay screen, a reduction process section that reduces the seconddisplay screen, and a movement process section that moves the seconddisplay screen, the position input device includes a touch detectionsection that acquires the information on the touched position, a secondstorage section storing touch history information including informationon a plurality of the touched positions thus acquired, a touchedposition determination section that determines whether a newly-acquiredtouched position is present in the near-field region specified by thedisplay information, and a display position determination section that,in a case where the touched position determination section hasdetermined that the newly-acquired touched position is present in thenear-field region, utilizes the touch history information to determineposition to which the second display screen is reduced or moved, in acase where the second display screen has not been reduced, the reductionprocess section reduces the second display screen to the position thusdetermined and displays the second display screen, and in a case wherethe second display screen has been reduced, the movement process sectionmoves the second display screen to the position thus determined anddisplays the second display screen.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1A to 1C are schematic views showing a configuration of a displayapparatus with an input function according to an embodiment of thepresent disclosure;

FIG. 2 is a block diagram showing a configuration of a position inputdevice (touch panel) of the display apparatus with an input functionaccording to the embodiment of the present disclosure;

FIG. 3 is a block diagram showing a configuration of an informationdisplay device according to the embodiment of the present disclosure;

FIGS. 4A to 4C are schematic explanatory diagrams of display screens andtouched positions in the display apparatus with an input functionaccording to the embodiment of the present disclosure;

FIGS. 5A to 5D are explanatory diagrams of a process of reducing asecond display screen (sub-screen) on the basis of a relationshipbetween the display position of the second display screen and a touchhistory according to the embodiment of the present disclosure;

FIGS. 6A to 6D are explanatory diagrams of a process of moving thesecond display screen (sub-screen) on the basis of the relationshipbetween the display position of the second display screen and the touchhistory according to the embodiment of the present disclosure;

FIGS. 7A to 7C are explanatory diagrams of the display position, basedon a touch history, of a second display screen (sub-screen) afterreduction according to the embodiment of the present disclosure;

FIGS. 8A and 8B are explanatory diagrams of the display position, basedon a touch history, of a second display screen (sub-screen) afterreduction according to the embodiment of the present disclosure;

FIGS. 9A and 9B are explanatory diagrams of the display position, basedon a touch history, of a second display screen (sub-screen) afterreduction according to the embodiment of the present disclosure;

FIGS. 10A to 10C are explanatory diagrams of the display position, basedon a touch history, of a second display screen (sub-screen) aftermovement according to the embodiment of the present disclosure;

FIGS. 11A and 11B are explanatory diagrams of the display position,based on a touch history, of a second display screen (sub-screen) aftermovement according to the embodiment of the present disclosure;

FIGS. 12A and 12B are flow charts of a process of, for example, reducinga sub-screen through the position input device (touch panel) accordingto the embodiment of the present disclosure;

FIG. 13 is a flow chart of the process of, for example, reducing asub-screen through the position input device (touch panel) according tothe embodiment of the present disclosure; and

FIGS. 14A and 14B are flow charts of a process of, for example, reducinga sub-screen through the information display device according to theembodiment of the present disclosure.

DESCRIPTION OF THE EMBODIMENTS

The following describes an embodiment of the present disclosure withreference to the drawings. It should be noted that the followingdescription of the embodiment is not intended to limit the presentdisclosure. Schematic Configuration of Display Apparatus with InputFunction

FIGS. 1A to 1C are schematic views showing a configuration of a displayapparatus 1 with an input function according to an embodiment of thepresent disclosure. As shown in FIGS. 1A to 1C, the display apparatus 1with an input function according to the embodiment of the presentdisclosure mainly includes a position input device 20 and an informationdisplay device 50. Further, the position input device 20 and theinformation display device 50 are placed on top of each other. Forexample, a tablet terminal, a smartphone, an electronic blackboard, alaptop PC, and the like are equivalent to the display apparatus 1 withan input function.

Further, as shown in FIG. 1A, the display apparatus 1 with an inputfunction is connected to an information processing device 2 (hereinafteralso referred to as “PC”) such as a personal computer. In accordancewith a request from the information processing device 2, the displayapparatus 1 with an input function displays, on the information displaydevice 50, image information that is supplied from the informationprocessing device 2. The display apparatus 1 with an input functiontransmits information on a position touched with an input pen, a finger,or the like from the position input device 20 to the informationprocessing device 2.

The position input device 20 is a device through which to inputinformation on a position touched with an input pen, a finger, or thelike. The position input device 20 is hereinafter also referred to as“touch panel TP”. As shown in FIG. 1B, the touch panel TP is placed overthe information display device 50. The touch panel TP is used forinputting information on a position touched with an input pen or thelike. The touch panel TP outputs a signal representing the coordinatesof a touched position.

It is on the basis of this signal representing the coordinates of atouched position that information (touch history information) indicatingsuch a history of touched positions as that described below is stored.Further, the signal representing the coordinates of a touched positionis supplied to the information processing device 2. Examples of methodsfor detecting a touched position include a capacitive method, aninfrared ray insulating method, an infrared camera method, anelectromagnetic induction method, a surface acoustic wave method, aresistive method, and the like. Any of these methods may be used.

The information display device 50 is a device (hereinafter also simplyreferred to as “display device” or “DS”) that displays information. Theinformation display device 50 mainly includes a display panel thatdisplays information and a control unit that receives an image displayrequest signal from the information processing device 2 and causes thedisplay panel to display an image in accordance with the image displayrequest signal. Usable examples of the display panel include a liquidcrystal panel, an organic EL panel, and the like. The display apparatus1 with an input function is manufactured by either joining the displaypanel and the touch panel, which are separate components, on top of eachother or integrally molding the display panel and the touch panel.

Upon execution of an operation of drawing a line segment by touching thetouch panel TP of the display apparatus 1 with an input function with aninput pen, information on the touched position is transmitted to theinformation processing device PC. On the basis of the receivedinformation on the touched position, the PC transmits, to the displaydevice DS, a display request signal for displaying the line segment inthe touched position. The line segment is displayed in a position on thedisplay screen that corresponds to the position where the line segmentwas drawn.

Further, as shown in FIG. 1C, the display apparatus 1 with an inputfunction has a so-called multiple-window display function. Apredetermined first image is displayed on a first display screen MD(main screen), which means the entire display screen of the displaydevice DS 50, and a second display screen PIP (sub-screen) 12 having asomewhat small display region is simultaneously displayed over a displayregion of a part of the first display screen MD (main screen) 11. Thissecond display screen PIP (sub-screen) 12 mainly shows a second imagethat is different from the first image that is displayed on the mainscreen MD. Note, however, that no part of the first image beingdisplayed on the first display screen MD (main screen) is displayed inthe display region in which the second display screen PIP (sub-screen)is being displayed.

The images to be displayed on the first display screen 11 and the seconddisplay screen PIP 12 are supplied from the information processingdevice PC to the display device DS 50. One or a plurality of theinformation processing devices PC may be connected to the displayapparatus 1 with an input function. For example, in a case where twoinformation processing devices PC are connected to the display apparatus1 with an input function, a first image that is supplied from the firstinformation device PC may be displayed on the first display screen MD(main screen), and a second image that is supplied from the secondinformation processing device PC may be displayed on the second displayscreen PIP (sub-screen).

Further, one or a plurality of the second display screens PIP(sub-screens) having small display regions may be displayed at a time.

It should be noted that the display position of a second display screenPIP (sub-screen) is not fixed in the position shown in FIG. 1C but maybe set in any position within the display screen of the display deviceDS 50. Further, the display position of a second display screen PIP(sub-screen) may be either set by the information processing device PCor freely changed by a user's touch input.

Further, according to the present disclosure, as will be describedlater, in a case where the second display screen PIP (sub-screen) 12 mayconstitute an obstacle when the user is inputting characters or the likewith an input pen in touch with a region on the touch panel TP thatcorresponds to the display region of the first display screen MD (mainscreen), the second display screen PIP (sub-screen) is automaticallyreduced on the basis of touch history information obtained by storingpositions of the user's touch input and then the second display screenPIP (sub-screen) is moved so as not to prevent the user's subsequenttouch input. Note, however, that in a case where the second displayscreen PIP (sub-screen) does not prevent the subsequent touch input inits reduced state, the second display screen PIP (sub-screen) does notnecessarily needs to be moved.

That is, according to the present disclosure, the processes of reducingand moving the second display screen PIP (sub-screen) 12 are executed intwo stages on the basis of the touch history information, whereby theburden of input operation on the user is reduced by allowing smoothcontinuation of the input operation of the user on the touch panel in astate where a plurality of display screens (multiple windows) are beingdisplayed.

Configuration of Position Input Device (Touch Panel)

FIG. 2 is a block diagram showing a configuration of the position inputdevice 20 (touch panel TP) of the display apparatus 1 with an inputfunction according to the embodiment of the present disclosure.

As shown in FIG. 2, the position input device 20 (touch panel TP)according to the embodiment of the present disclosure mainly includes aninput control section 21, a touch information transmission section 22, acommunication section 23, a display information acquisition section 24,a touch detection section 25, a touched position determination section26, a display position determination section 27, a reduction informationnotification section 28, a movement information notification section 29,and a storage section 30.

The input control section 21 is a section that controls the operation ofeach constituent element such as the touch detection section 25, and ismainly realized by a microcomputer including a CPU, a ROM, a RAM, an I/Ocontroller, a timer, and the like.

The CPU organically actuates various types of hardware on the basis of acontrol program stored in advance in the ROM or the like and executesthe touch detection function, the communication function, or otherfunctions of the position input device 20 (touch panel TP) according tothe embodiment of the present disclosure.

The touch information transmission section 22 is a section thattransmits, to the PC, information on a position touched by an input penor the like. In a case where a position on the touch panel TP isrepresented by orthogonal XY coordinates, the coordinates (x, y) of thetouched position is transmitted to the PC.

The communication section 23 is a section that is equivalent to a secondcommunication section and communicates with the display device DS. Thecommunication section 23 transmits information acquired or generatedthrough the touch panel TP to the display device DS and receives displayinformation from the display device DS. For example, the communicationsection 23 may transmit, to the display device DS, at least either orboth of information on a position determined by the after-mentioneddisplay position determination section 27 as a position to which thesub-screen PIP is reduced and information on a position determined bythe after-mentioned display position determination section 27 as aposition to which the sub-screen PIP is moved. Note, however, that in acase where the sub-screen PIP is reduced, the communication section 23may transmit, to the display device DS, only information (reductioninformation) pertaining to the size and position to which the sub-screenPIP is reduced.

The display information acquisition section 24 is a section thatacquires display information sent from the display device DS. Forexample, the display information acquisition section 24 acquires asub-screen position and near-field region information that are includedin the display information thus received and stores them in the storagesection 30.

The touch detection section 25 is a section that detects the touch ofthe touch panel TP with an input pen, a finger, or the like and acquiresinformation (touched position coordinates) on the touched position. Theinformation on the touched position thus acquired is transmitted by thetouch information transmission section 22 to the PC and, atpredetermined time intervals, is stored as touch history information 31in the storage section 30.

The touched position determination section 26 is a section thatdetermines whether the touched position thus acquired is present in thedisplay position of the sub-screen PIP or a near-field region specifiedby the after-mentioned display information. The near-field region issuch a region as that shown in FIGS. 4B and 4C, which will be describedlater. For example, in a case where the information (touched positioncoordinates) on the touched position falls within the range of displaycoordinates indicating the display region of the sub-screen PIP thatcorresponds to the touch panel TP, the touched position determinationsection 26 determines that the touched position is present in thedisplay position of the sub-screen PIP. Further, in a case where theinformation (touched position coordinates) on the touched position fallswithin the range of display coordinates indicating the near-field regionthat corresponds to the touch panel TP, the touched positiondetermination section 26 determines that the touched position is presentin the near-field region.

In a case where the touched position determination section 26 hasdetermined that the touched position thus acquired is present in thenear-field region or the display position of the sub-screen PIP, theafter-mentioned display position determination section 27 determines theposition to which the sub-screen PIP is reduced and the position towhich the sub-screen PIP is moved. Further, in a case where the touchedposition approaches the near-field region or the display position of thesub-screen PIP with the passage of time on the basis of the touchhistory information 31 stored in the storage section 30, the distancebetween the touched position and the near-field region or the like andthe direction in which the touched position approaches the near-fieldregion or the like (direction of movement of the touched position) maybe detected.

The display position determination section 27 is a section that, in acase where the touched position determination section 26 has determinedthat a newly-acquired touched position is present in the near-fieldregion or the display position of the sub-screen PIP, determines, withreference to the touch history information 31 stored in the storagesection 30, the position to which the sub-screen PIP is reduced and theposition to which the sub-screen PIP is moved. Alternatively, instead ofdirectly determining the size and display position to which thesub-screen PIP is reduced and the display position to which thesub-screen PIP is moved, the display position determination section 27needs only determine the area of placement of and the direction ofmovement of the sub-screen PIP with respect to the entire display screenof the display device DS.

According to the present disclosure, assuming that a two-stage processby which the process of reducing the sub-screen PIP is followed by theprocess of moving the sub-screen PIP is performed in a case where thedisplay position of the sub-screen PIP may affect the user's touchinput, the sub-screen PIP is first reduced to the determined position ofreduction in a case where the sub-screen PIP has not been reduced yet.That is, the size and display position of the sub-screen PIP afterreduction are determined.

Criteria for reduction need only be set in advance; for example, theoriginal sub-screen PIP may be reduced to approximately 1/4 in arearatio. Alternatively, some reduction ratios may be set in advance sothat the sub-screen PIP may be made gradually smaller. Further, thereduction ratios may be user-configurable.

Further, the position in which the sub-screen PIP after reduction isdisplayed may be determined according to such criteria as thosementioned below to be such a position as not to affect touch input afterthe reduction of the sub-screen PIP. Information on the display positionand size thus determined of the sub-screen PIP after reduction istransmitted as reduction information by the after-mentioned reductioninformation notification section 28 to the display device DS.

Next, for example, in a case where the sub-screen PIP has been reducedonce, the sub-screen PIP is moved to the determined position ofmovement. That is, the display position of the sub-screen PIP aftermovement is determined. Further, the number of reductions and themaximum reduction ratio may be set in advance so that the sub-screen PIPmay be moved in a case where a reduction process has been performed thenumber of reductions thus set or a case where a reduction has alreadybeen made at the maximum reduction ratio.

Criteria for moving the sub-screen PIP need only be set in advance, andaccording to such criteria as those mentioned below, such a positionneeds only be determined as to be not likely to affect the subsequenttouch input. For example, in a case where the entire display screen ofthe display device DS is segmented into some segmented regions and thereis a segmented region including none of the touched positions stored asthe touch history information, it may be determined that the sub-screenPIP moves into the segmented region. Alternatively, it is possible tocompute, from some recent touched positions stored as the touch historyinformation, the locus and direction of movement of a touched positionuntil the present time, to predict, on the basis of the locus ofmovement and the like, the direction of movement of the position to betouched in the future, and to determine that the sub-screen PIP movesinto a segmented region that does not lie in the direction of movementthus predicted. Information on the display position thus determined ofthe sub-screen PIP after movement is transmitted as movement informationby the after-mentioned movement information notification section 29 tothe display device DS.

Further, the size of the sub-screen PIP after movement may be the sameas the size of the sub-screen PIP after reduction. Note, however, thatthe sub-screen PIP after movement may be returned to the same size asthe original sub-screen PIP.

It should be noted that, in the touch panel TP, the display positiondetermination section 27 may execute both a reduction determinationprocess and a movement determination process on the basis of the touchhistory information and transmit the reduction information and movementinformation thus determined to the display device DS. In this case, thedisplay device DS determines whether the process of reducing thesub-screen PIP or the process of moving the sub-screen PIP is performed.

The reduction information notification section 28 is a section thattransmits, to the display device DS, the reduction information on thesub-screen PIP as determined by the display position determinationsection 27. The movement information notification section 29 is asection that transmits, to the display device DS, the movementinformation on the sub-screen PIP as determined by the display positiondetermination section 27.

In a case where the touch panel TP determines whether the sub-screen PIPis reduced or moved, it is only necessary, for example, to, in a casewhere no reduction determination has been made, perform the reductiondetermination process of determining the position of the sub-screen PIPafter reduction and transmit only the reduction information on thesub-screen PIP to the display device DS and to, once a reductiondetermination is made, perform the movement determination process ofdetermining the position of the sub-screen PIP after movement andtransmit only the movement information on the sub-screen PIP to thedisplay device DS.

On the other hand, in a case where the display device DS determineswhether the sub-screen PIP is reduced or moved, it is only necessary toexecute both the reduction determination process and the movementdetermination process through the touch panel TP and transmit, to thedisplay device DS, the reduction information by which the position ofthe sub-screen PIP after reduction is set and the movement informationby which the position of the sub-screen PIP after movement is set.

The storage section 30 is a section that is equivalent to a secondstorage section and stores information and programs that are necessaryfor executing the functions of the touch panel TP. Usable examples ofthe storage section 30 include: a semiconductor storage element such asa ROM, a RAM, a flash memory; a storage device such as an HDD and anSSD; and other storage media.

A program is stored in the ROM. Information that is temporarily utilizedis stored in the RAM. Information that is set in advance is stored in anonvolatile rewritable storage element such as the flash memory.

In the storage section 30, for example, the touch history information31, reduction information 32, movement information 33, and displayinformation 34 are stored. The display information 34 is informationpertaining to the sub-screen PIP that is acquired from the displaydevice DS, and is information including a sub-screen position 35 andnear-field region information 36.

The touch history information 31 includes information on a plurality oftouched positions acquired by the touch detection section 25 and isobtained by storing, for a predetermined period of time, information(touched position coordinates) indicating touched positions on the touchpanel TP. For example, touched position coordinates acquired every 100milliseconds are stored as a history for a period from a time ten secondago to the present time. Alternatively, touched position coordinatesfrom a position on the touch panel TP that an input pen first touched(touched down) to a position on the touch panel TP from which the inputpen moved away (touched up) may be stored as a history at intervals of100 milliseconds.

The reduction information 32 is information pertaining to the sub-screenPIP in a case where the sub-screen PIP is reduced, and includes, forexample, information on the display position of the sub-screen PIP afterreduction and information on a near-field region corresponding to thesub-screen PIP after reduction. The information on the display positionof the sub-screen PIP after reduction may be coordinate information thatspecifies the display position and size of the sub-screen PIP and, in acase where the display screen of the display device DS is segmented intosome segmented regions, may designate a segmented region in which thesub-screen PIP after reduction should be displayed.

The near-field region is a region that includes the sub-screen PIP andis larger than the sub-screen PIP. In a case where the sub-screen PIPhas a rectangular shape whose transverse length is W0 and longitudinallength is L0, the near-field region is a rectangular region thatincludes the sub-screen PIP therein and has, around the display regionof the sub-screen PIP, a width that is larger by a predetermineddistance. As shown in FIG. 4B, which will be described later, assumingthat the near-field region is sized to have a transverse length W1 and alongitudinal length L1, W1>W0 and L1>L0.

This near-field region is a region for detecting the approach of aposition of touch or a history of touches with an input pen or the liketo the display position of the sub-screen PIP. For example, in a casewhere a touched position detected by the touch detection section 25 iswithin the near-field region and outside the region of the sub-screenPIP, the size and display position to which the sub-screen PIP isreduced are determined and the reduction information 32 is generated. Ina case where the sub-screen PIP is reduced, the reduced sub-screen PIPis displayed in the determined position on the basis of the reductioninformation 32 thus generated.

The movement information 33 is information pertaining to the sub-screenPIP in a case where the sub-screen PIP is moved, and includes, forexample, information on the display position of the sub-screen PIP aftermovement and information on a near-field region corresponding to thesub-screen PIP after movement. The information on the display positionof the sub-screen PIP after movement may be coordinate information thatspecifies the display position and size of the sub-screen PIP and, in acase where the display screen of the display device DS is segmented intosome segmented regions, may designate a segmented region in which thesub-screen PIP after movement should be displayed.

In a case where a touched position detected by the touch detectionsection 25 is within the near-field region and outside of the region ofthe sub-screen PIP, the display position to which the sub-screen PIP ismoved is determined and the movement information 33 is generated.Alternatively, in a case where a history of touched positions stored iswithin the near-field region and further enters the region of thesub-screen PIP, the movement information 33 may be generated. In a casewhere the sub-screen PIP is moved, the sub-screen PIP is displayed inthe determined position, to which the sub-screen PIP should be moved, onthe basis of the movement information 33 thus generated.

As described above, the display information 34 is information includingthe sub-screen position 35 and the near-field region information 36. Thesub-screen position 35 is information (position coordinates) indicatingthe display position of the sub-screen PIP currently displayed on thedisplay screen of the display device DS. The near-field regioninformation 36 is information that indicates the position of anear-field region corresponding to the currently-displayed sub-screenPIP.

Further, since the display position of the current sub-screen PIP isstored in the display device DS, the display information 34 istransmitted from the display device DS in the case of such a change inthe size or display position of the sub-screen PIP as a reduction ormovement of the sub-screen PIP. Note, however, that the displayinformation 34 may be regularly transmitted from the display device DS.

It should be noted that although the display information 34 that istransmitted from the display device DS includes the near-field regioninformation 36, the display information 34 that is transmitted from thedisplay device DS does not need to include the near-field regioninformation 36 in a case where the touch panel TP manages the size of anear-field region. In this case, the touch panel TP needs only computethe near-field region information 36 from the sub-screen position 35that is transmitted from the display device DS.

FIGS. 4A to 4C are schematic explanatory diagrams of display screens andtouched positions in the display apparatus 1 with an input functionaccording to the embodiment of the present disclosure. FIG. 4A shows anexample display of a first display screen (main screen) MD that isdisplayed all over the display panel of the display device DS and a linesegment inputted by touch to the touch panel TP placed over the firstdisplay screen (main screen) MD.

FIG. 4A assumes that the first display screen (main screen) MD has arectangular shape and that, in order to specify the display position ofthe first display screen (main screen) MD, XY coordinates are set sothat the origin point is located in a lower left position on the mainscreen MD, the X axis extends in a transverse direction, and the Y axisextends in a longitudinal direction. Assuming that AO (0, 0) is theorigin point of the XY coordinates, Xn is the number of pixels in the Xaxis direction, and Ym is the number of pixels in the Y axis direction,A1 (Xn, 0), A3 (0, Ym), and A2 (Xn, Ym) represent lower right, upperright, and upper left positions on the main screen MD, respectively. Ina case where a sub-screen PIP is displayed, the display position of thesub-screen PIP is represented by the XY coordinates.

Further, FIG. 4A also shows a touch history 14 in a case where a linesegment is inputted by a user bringing an input pent into touch with thetouch panel TP placed over the first display screen (main screen) MD.The touch history 14 is a displayed locus of the pen. Assuming that thedirection of movement of the input pen (touch movement direction) is thedirection of the arrow, the coordinates of the current touched positionPti is for example represented by (Xi, Yi). Note here that, assumingthat the coordinates of a touched position on the touch panel TP and thecoordinates of the display position of the main screen MD are inone-to-one correspondence, the touched position Pti (Xi, Yi) of theinput pen is also the coordinates of the display position.

FIG. 4B shows an example display of a second display screen (sub-screen)PIP 12 and a near-field region NF 13 displayed on a part of the firstdisplay screen (main screen) MD and a touch history 14 of a line segmentinputted to the first display screen (main screen) MD. In a case wherethe second display screen (sub-screen) PIP 12 has a rectangular shape,the near-field region NF 13 has a rectangular shape that is slightlylarger than the sub-screen PIP. The position of the near-field region NFcorresponding to the sub-screen PIP is also represented by the XYcoordinates shown in FIG. 4A.

Further, in FIG. 4B, the line segment indicated by the touch history 14and the current touched position Pti (Xi, Yi) are outside of thenear-field region NF, and in such a state as that shown in FIG. 4B wherethe sub-screen PIP does not constitute an obstacle to touch input fromthe input pen, the sub-screen PIP does not need to be reduced or moved.

FIG. 4C shows an example of a positional relationship between the seconddisplay screen (sub-screen) PIP 12 and the near-field region NF 13. Thesub-screen PIP is a rectangular region surrounded by four apices (P0,P1, P2, and P3), and the near-field region NF is a rectangular regionsurrounded by four apices (K0, K1, K2, and K3).

Note here that W1>W0 and L1>L0, where W0 is the transverse length of thesub-screen PIP, L0 is the longitudinal length of the sub-screen PIP, W1is the transverse length of the near-field region NF, and L1 is thelongitudinal length of the near-field region NF. Further, for example,the sub-screen position 35 and the near-field region information 36 arespecified by the XY coordinates of the four apices of each of therectangular shapes.

The size and display position of the sub-screen PIP to be displayed aredetermined, for example, by the settings that the user configures forthe display device DS. Further, the transverse and longitudinal lengthsof the near-field region NF need only be set to be for exampleapproximately 20 to 40% larger than the transverse and longitudinallengths of the sub-screen PIP. Note, however, that while the transverseand longitudinal lengths of the near-field region NF may be fixedly setin advance, the transverse and longitudinal lengths of the near-fieldregion NF may also be user-configurable, as appropriate values of thetransverse and longitudinal lengths of the near-field region NF varydepending on the sizes of the main screen MD and the sub-screen PIP, theresolution of a signal being inputted to the main screen MD, and thelike.

Configuration of Information Display Device

FIG. 3 is a block diagram showing a configuration of the informationdisplay device DS 50 according to the embodiment of the presentdisclosure. As shown in FIG. 3, the information display device DS 50according to the embodiment of the present disclosure mainly includes adisplay control section 51, a display panel 52, an operation inputsection 53, an image input section 54, an image processing section 55, acommunication section 56, a display position acquisition section 57, areduction process section 58, a movement process section 59, and astorage section 60.

The display control section 51 is a section that controls the operationof each constituent element such as the image input section 54 and thecommunication section 56, and is mainly realized by a microcomputerincluding a CPU, a ROM, a RAM, an I/O controller, a timer, and the like.

The CPU organically actuates various types of hardware on the basis of acontrol program stored in advance in the ROM or the like and executesthe display function, the function of reducing a sub-screen PIP, thefunction of moving a sub-screen PIP, the communication function, orother functions of the display device DS.

The display panel 52 is a section that displays an image. In particular,according to the present disclosure, the display panel 52 displays afirst display screen (main screen MD) all over the panel and displays asecond display screen (sub-screen PIP) in a display region of the firstdisplay screen (main screen MD). Further, the display panel 52 displayspredetermined images in the main screen MD and the sub-screen PIP inaccordance with display signals that are supplied from the displaycontrol section 51. Usable examples of the display panel 52 include aliquid crystal panel, an organic EL panel, and the like.

The operation input section 53 is a section through which a userperforms, an image displayed on the display panel 52, an operation ofexecuting a predetermined function. Usable examples of the operationinput section 53 include a keyboard and a remote controller.

The image input section 54 is a section through which to input a videosignal for displaying an image that is supplied from an informationprocessing device PC such as a personal computer, and has an interfacethat complies with a predetermined video standard such as analog RGB,DVI, or HDMI (registered trademark). The video signal that is inputtedmay be either analog or digital.

The image processing section 55 is a section that converts an inputtedvideo signal into a signal that can be displayed on the display panel52. For example, a video signal representing an image to be displayed onthe sub-screen PIP is adjusted so that the image is displayed in thepredetermined display position of the sub-screen PIP.

The communication section 56 is a section that is equivalent to a firstcommunication section and communicates with the touch panel TP. Thecommunication section 56 transmits display information 62 stored in thestorage section 60 to the touch panel TP. The display information 62 isinformation pertaining to the display position of the sub-screen PIPcurrently displayed on the display device DS and a near-field region.Further, the communication section 56 receives information (displayposition acquisition information) pertaining to the display position ofthe sub-screen PIP that is sent from the touch panel TP. The displayposition acquisition information is equivalent to reduction informationand movement information generated by the touch panel TP.

The display position acquisition section 57 is a section that acquiresinformation (display position acquisition information) pertaining to thedisplay position of the sub-screen PIP that is sent from the touch panelTP and stores the display position acquisition information in thestorage section 60. The display position acquisition informationincludes information (reduction information) pertaining to the displayposition of the sub-screen PIP after reduction and information (movementinformation) pertaining to the display position of the sub-screen PIPafter movement.

The reduction process section 58 is a section that reduces a sub-screenPIP on the basis of acquired information (reduction information)pertaining to the display position of the sub-screen PIP afterreduction. For example, in a case where the sub-screen PIP has not beenreduced once, the reduction process section 58 utilizes the reductioninformation to determine the size and display position of the sub-screenPIP, reduces the sub-screen PIP to the position of reduction thusdetermined, and displays the sub-screen PIP.

The movement process section 59 is a section that moves a sub-screen PIPon the basis of acquired information (movement information) pertainingto the display position of the sub-screen PIP after movement. Forexample, in a case where the sub-screen PIP has been reduced, themovement process section 59 utilizes the movement information todetermine a display position to which the sub-screen PIP is moved, movesthe sub-screen PIP to the position of movement thus determined, anddisplays the sub-screen PIP.

The storage section 60 is a section that is equivalent to a secondstorage section and stores information and programs that are necessaryfor executing the functions of the display device DS. Usable examples ofthe storage section 60 include: a semiconductor storage element such asa ROM, a RAM, a flash memory; a storage device such as an HDD and anSSD; and other storage media.

A program is stored in the ROM. Information that is temporarily utilizedis stored in the RAM. Information that is set in advance is stored in anonvolatile rewritable storage element such as the flash memory.

In the storage section 60, for example, sub-screen initial positioninformation 61, the display information 62, and display positionacquisition information 65 are stored. Further, the display information62 includes such a sub-screen position 63 indicating the displayposition of a second display screen (sub-screen PIP) as that describedabove and such near-field region information 64 as that described above.The display position acquisition information 65 includes such reductioninformation 66 as that described above and such movement information 67as that described above.

The sub-screen initial position information 61 is information thatindicates a display position in which the sub-screen PIP was firstdisplayed. The sub-screen initial position information 61 is utilized ina case where there has been no touch input from an input pen since thesub-screen PIP was reduced or moved or when the sub-screen PIP isreturned by the user's instruction input or the like to an initial statein which the sub-screen PIP was first displayed.

The sub-screen position 63 and the near-field region information 64,which are included in the display information 62, are informationpertaining to the sub-screen PIP currently displayed on the displaydevice DS. Further, the reduction information 66 and the movementinformation 67, which are included in the display position acquisitioninformation 65, are equivalent to the reduction information 32 and themovement information 33, which are generated by the touch panel TP.

Explanation of Reduction of Second Display Screen (Sub-Screen) andChange in Display Position>

According to the present disclosure, such a touch history 14 of an inputpen as that described above is utilized to reduce a sub-screen PIP andfurther move the sub-screen PIP on the basis of a relationship betweenthe display position of the sub-screen PIP, a near-field region, and thetouched position and touch movement direction of the touch panel TP.

FIGS. 5A to 5D are explanatory diagrams of a process of reducing asecond display screen (sub-screen) on the basis of a relationshipbetween the display position of the second display screen and a touchhistory according to the embodiment of the present disclosure.

FIGS. 6A to 6D are explanatory diagrams of a process of moving thesecond display screen (sub-screen) on the basis of the relationshipbetween the display position of the second display screen and the touchhistory according to the embodiment of the present disclosure. In thisembodiment, the sub-screen PIP is reduced first and then moved. FIGS. 5Cand 6A are explanatory diagrams showing the same state where thesub-screen PIP has been reduced.

FIG. 5A shows a state where a main screen MD 11 is being displayed allover the display screen of the display device DS 50 and a sub-screen PIP12 is being displayed in a lower right region of the main screen MD.Further, a near-field region NF 13 which is slightly larger than adisplay region of the sub-screen PIP is indicated by a dashed line.Furthermore, it is assumed that input is started by an input pen beingbrought into touch with an upper left part of a display region of themain screen MD and the input pen is moved in the direction of the arrowwhile being kept in touch. The line segment indicates a touch history 14of the input pen.

Although, in FIG. 5A, the touch history 14 of the input pen isapproaching in the direction of the near-field region NF, the sub-screenPIP is kept displayed without change, as the touch history 14 of theinput pen has not entered the near-field region NF yet.

FIG. 5B shows a state where the input pen continues the touch input andhas been brought into touch with an upper left part of the near-fieldregion NF. In this case, the touched position determination section 26determines that a touched position acquired by the touch detectionsection 25 is present in the near-field region NF. Further, since thetouched position determination section 26 has determined that thetouched position thus acquired is present in the near-field region NF,the display position determination section 27 utilizes the touch history14 to determine a position in which the sub-screen PIP is displayed.Specifically, the position to which the sub-screen PIP should be reducedand the position to which the sub-screen PIP should be moved aredetermined. Note, however, that in a case where the sub-screen PIP hasnot been reduced once yet since the sub-screen PIP was initiallydisplayed, only the position to which the sub-screen PIP should bereduced may be determined. For example, as shown in FIG. 5C, the displayposition of the sub-screen PIP is determined so that the sub-screen PIPis reduced in a lower right direction in the display region of the mainscreen MD, i.e. in a direction away from the current touched position.

FIGS. 7A to 7C, FIGS. 8A and 8B, and FIGS. 9A and 9B are explanatorydiagrams of the display position, based on a touch history, of a seconddisplay screen (sub-screen PIP) after reduction according to theembodiment of the present disclosure.

Here, three display positions of a sub-screen PIP after reduction areshown.

FIG. 7A shows four segmented regions (BA1 to BA4) into which thesub-screen PIP and the near-field region NF have been segmented invertical and horizontal directions.

A method for determining the display position of a sub-screen PIP afterreduction includes, when a touch inputted position has first entered thenear-field region NF, checking in which segmented region of thenear-field region NF the touched position is present and reducing thesub-screen PIP in a diagonal direction of the segmented region in whichthe touched position is present.

For example, in such a case as that shown in FIG. 7B where the touchhistory 14 moves and the touched position has entered the segmentedregion BA1, which is the upper left one of the four segmented regions ofthe near-field region NF, the sub-screen PIP is displayed after beingreduced in the direction of the segmented region BA4, which lies in adiagonal direction of the segmented region BA1.

Further, FIG. 8A shows a case where the touch history 14 has moved fromthe left and the touched position has entered the segmented region BA3,which is the lower left one of the four segmented regions of thenear-field region NF. In this case, it is the segmented region BA2 thatlies in a diagonal direction of the segmented region BA3. Therefore, asshown in FIG. 8B, the sub-screen PIP is displayed after being reduced inthe direction of the segmented region BA2.

Thus, reducing the sub-screen PIP in a diagonal direction of a segmentedregion of the near-field region NF that the touched position has enteredprevents the sub-screen PIP after reduction from constituting anobstacle to touch input, even if the touch history 14 moves furtherinside the region in which the original sub-screen PIP was displayed.This allows the user to continue the input without performing a specialoperation.

Further, another method for determining the display position of asub-screen PIP after reduction may include predicting, from informationon a plurality of touched positions included in the touch historyinformation, the direction of travel of the position to be touched inthe future and determining, as the position in which to display thesub-screen PIP reduced to a predetermined size, a position that is outof the direction of travel of the touched position. A time-seriesarrangement of information on a plurality of touched positions includedin the touch history information shows the direction of travel of thetouch history 14 until the present time, thus making it possible topredict the direction of travel of the touch history 14 in the future.

FIG. 9A shows a case where the touch history 14 has moved from the upperleft and the touched position has entered the segmented region BA1,which is the upper left one of the four segmented regions of thenear-field region NF. In this case, the position of entrance of thetouch position is in a part of the segmented region BA1 that is closeits neighbor segmented region BA2 on the right and the direction ofmovement of the touch history 14 is a diagonally downward rightdirection; therefore, it can be predicted that the direction of travelof the touch history 14 in the future is within the segmented regionBA2. Accordingly, as shown in FIG. 9B, the sub-screen PIP isautomatically reduced in the direction of the lower left segmentedregion BA3, to which the touch history 14 is considered to be not likelyto travel in the future.

Thus, checking the position of a segmented region of the near-fieldregion that the touched position has entered and the direction ofmovement of the touch history 14, predicting the direction of travel ofthe touch history 14 in the future, and thereby reducing the sub-screenPIP in the direction in which the touch history 14 is considered to benot likely to travel in the future prevents the sub-screen PIP afterreduction from constituting an obstacle to touch input, even if thetouch history 14 moves further inside the region in which the originalsub-screen PIP was displayed. This allows the user to continue the inputwithout performing a special operation.

As shown in FIG. 5C described above, by automatically reducing thesub-screen PIP in the lower right direction in the display region of themain screen MD, it is made possible to continue the input operation withthe input pen for a while in a position that does not overlap thesub-screen PIP after reduction.

Further, in a case where it is possible to further reduce the sub-screenPIP, it is only necessary to, in a case where the touched position hasentered the near-field region NF shown in FIG. 5C, automatically reducethe sub-screen PIP further in the lower right direction in the displayregion of the main screen MD as shown in FIG. 5D. In the case shown inFIG. 5D, the sub-screen PIP in the initial position shown in FIG. 5A hasbeen reduced in two stages. That is, in a case where the process ofreducing the sub-screen PIP is performed, the sub-screen PIP may bedisplayed after being gradually reduced more than once to the determinedposition of reduction.

Note, however, that in a case where the sub-screen PIP has been reducedonce and cannot be further reduced, the sub-screen PIP is moved as shownin FIGS. 6A to 6D. As with FIG. 5C, FIG. 6A shows a state where thesub-screen PIP has been reduced.

In a case where the touch history 14 further travels in the lower rightdirection from this state and the touched position has entered thenear-field region NF shown in FIG. 6A, the sub-screen PIP is moved, asshown in FIG. 6B, in the direction of a region that has been free of thetouch history 14 until the present time.

FIGS. 10A to 10C and FIGS. 11A and 11B are explanatory diagrams of thedisplay position, based on a touch history, of a second display screen(sub-screen) after movement according to the embodiment of the presentdisclosure. Here, two display positions of a sub-screen PIP aftermovement are shown. FIG. 10A shows four segmented regions (BM1 to BM4)into which the main screen MD has been segmented in vertical andhorizontal directions. Further, FIG. 10A shows a state where thesub-screen PIP is displayed in the segmented region BM4, which is thelower right one of the four-segmented regions, and a near-field regionNF is also included in the segmented region BM4.

A method for determining the display position of a sub-screen PIP aftermovement includes storing, in a time-series manner, segmented regionsthat the touch history 14 entered and moving the sub-screen PIP to asegmented region that the touch history 14 has not entered. That is, ina case where it has been confirmed, with reference to the information onthe plurality of touched positions included in the touch historyinformation, that the display region of the first display screen (mainscreen) includes a segmented region that has not been touched until thepresent time since a touch was started, the segmented region that hasnot been touched is determined as a region to which the sub-screen PIPis moved. Alternatively, in a case where there is no segmented regionthat has not been touched, the sub-screen PIP needs only be moved to thesegmented region touched at the most distant time.

Assume that in a state where the sub-screen PIP is displayed in thelower right segmented region BM4 as shown in FIG. 10A, touch input isstarted in the upper left segmented region of the main screen MD and thetouch history 14 enters the segmented region BM2 from the segmentedregion BM1 and further enters the near-field region NF in the segmentedregion BM4 as shown in FIG. 10B. In this case, the touch history 14 hasmoved through three segmented regions (BM1, BM2, and BM4) but has notentered the lower left segmented region BM3 yet.

Accordingly, as shown in FIG. 10C, the sub-screen PIP is moved to thelower left segmented region BM3, on which no touch input has beenperformed. At this time, there is no change in the size of thesub-screen PIP.

Thus, in a case where the touch history 14 has entered the near-fieldregion NF of the sub-screen PIP and there is a segmented region on whichno touch input has been performed yet since the start of touch input,moving the sub-screen PIP to the segmented region prevents thesub-screen PIP after movement from constituting an obstacle to the touchinput, even if the touch history 14 moves further inside the segmentedregion in which the original sub-screen PIP was displayed. This allowsthe user to continue the input without performing a special operation.

Further, in a case where there is no segmented region on which no touchinput has been performed since the start of touch input, the sub-screenPIP is moved to the segmented region touched at the most distant timefrom the time-series perspective of the touch history 14. This makes itpossible to move the sub-screen PIP to a segmented region that is farfrom the segmented region on which touch input has been performed mostrecently and that is considered to be not likely to receive touch inputin the future.

Further, another method for determining the display position of asub-screen PIP after movement may include predicting, from informationon a plurality of touched positions included in the touch historyinformation, the direction of travel of the position to be touched inthe future and determining, as the position to which the sub-screen PIPis moved, a position that is out of the direction of travel of thetouched position. A time-series arrangement of information on aplurality of touched positions included in the touch history informationshows the direction of travel of the touch history 14 until the presenttime, thus making it possible to predict the direction of travel of thetouch history 14 in the future.

FIG. 11A shows a case where the touch history 14 has moved inside theupper right segmented region BM2 and entered the lower right segmentedregion BM4 from above the segmented region BM4 and the touched positionhas entered the near-field region NF in the segmented region BM4.

In this case, the time-series direction of movement of the touch history14 is a diagonally downward left direction; therefore, it can bepredicted that the direction of travel of the touch history 14 in thefuture is similarly a diagonally downward left direction. That is, it ispredicted that the touch history 14 is highly likely to move from thesegmented region BM4 to the lower left segmented region BM3 in thefuture and is not likely to move to the upper left segmented region BM1in the future. Therefore, although the two left segmented regions (BM1and BM3) are both segmented regions on which no touch input has beenperformed yet, the sub-screen PIP is moved to the upper left segmentedregion BM1 as shown in FIG. 11B.

In such a case where the touch history 14 has entered the near-fieldregion NF of the sub-screen PIP, predicting the direction of the touchhistory 14 in the future and moving the sub-screen PIP to a segmentedregion considered not to lie in the direction of movement in the futureprevents the sub-screen PIP after movement from constituting an obstacleto touch input, even if the touch history 14 moves further inside thesegmented region in which the original sub-screen PIP was displayed.This allows the user to continue the input without performing a specialoperation.

In the case shown in FIG. 6B described above, the touch start positionis in the upper segmented region of the main screen MD, the direction ofmovement of the touch history 14 until the present time is a downwardright direction, and no touch input has been performed on the lower leftsegmented region; therefore, the sub-screen PIP is moved to the lowerleft segmented region, on which no touch input has been performed. Asshown in FIG. 6B, by automatically moving the sub-screen PIP in a lowerleft direction in the display region of the main screen MD, it is madepossible to continue the input operation with the input pen for a whilein a position that does not overlap the sub-screen PIP after movement.

FIGS. 6C and 6D show a case where the sub-screen PIP is returned to theinitial position shown in FIG. 5A. In a case where the input pen hasended the touch (touch up), there is a case where it is preferable toreturn the sub-screen PIP to the initial position in order to confirmthe display content of the sub-screen PIP. Accordingly, in a case wherethe touch detection section 25 has not acquired information on a touchedposition for a predetermined period of time or longer since thesub-screen PIP was reduced or moved, the initial position information 61is utilized to return the sub-screen PIP to the display position inwhich the sub-screen PIP was first displayed.

Assume, for example, that the input pen has ended the touch (touched up)in the state shown in FIG. 6B and a predetermined period of time (e.g. 5seconds) has elapsed in a state where a line segment inputted by theinput pen is displayed as shown in FIG. 6C. At this time, it isdetermined that there is no touch with the input pen in the future, andas shown in FIG. 6D, the sub-screen PIP is automatically returned to theinitial position shown in FIG. 5A. Further, the size of the sub-screenPIP is returned to the same size as that of the sub-screen PIP in theinitial position shown in FIG. 5A.

Thus, in a case where there is no longer touch input from the input pen,the user, without performing a special operation, returns the sub-screenPIP to the initial position while the main screen MD is displaying theinformation inputted thereto. This makes it impossible to, in a casewhere the sub-screen PIP overlaps a part of the information inputted tothe main screen MD, see the information in the overlapped position, butmakes it possible to confirm the information on the sub-screen PIP inits original size.

Further, in a case where returning the sub-screen PIP to the initialposition causes the sub-screen PIP to overlap a part of the informationinputted to the main screen MD, it is possible to return the sub-screenPIP to the initial position a predetermined period of time after awarning display indicating that the sub-screen PIP overlaps a part ofthe input information. In a case where, during the warning display, theuser has performed input to cancel the returning of the sub-screen PIPto the initial position, the display shown in FIG. 6C may be keptunchanged without the sub-screen PIP being returned to the initialposition.

Alternatively, it is possible to return the sub-screen PIP to theinitial position in a case where the sub-screen PIP in the initialposition overlaps none of the information inputted to the main screenMD. Furthermore, in a case where the initial position of the sub-screenPIP overlaps a part of the information inputted to the main screen MD,it is possible to move the sub-screen PIP to a region, if any, on themain screen MD where the sub-screen PIP of the original size does notoverlap the information inputted to the main screen MD.

Process of Reducing and Moving Sub-Screen Through Position Input Device(Touch Panel)

FIGS. 12A and 12B and FIG. 13 are flow charts of a process of, forexample, reducing a sub-screen through the position input device 20(touch panel TP) according to the embodiment of the present disclosure.In the embodiment shown here, reduction information and movementinformation are created by performing both a reduction determinationprocess and a movement determination process on a display region of asub-screen PIP in a case where a touched position is present in anear-field region of the sub-screen PIP. Note, however, that it is alsopossible to first create the reduction information by performing thereduction determination process and then create the movement informationby performing the movement determination process after having reducedthe sub-screen PIP.

In step S1 of FIG. 12A, the input control section 21 sets a touchstorage interval timer T1 into a time-out state. The touch storageinterval timer T1 is a timer that measures time intervals at whichtouched positions are stored in the touch history information 31. Everytime the touch storage interval timer T1 times out, acquired informationon the coordinates of an acquired touched position is stored in thetouch history information 31. The time that the touch storage intervaltimer T1 measures is for example 100 milliseconds.

In step S2, the input control section 21 sets a non-touch detectiontimer T2 into a stopped state. The non-touch detection timer T2 is atimer that measures the time during which the touch panel TP is nottouched. In a case where the non-touch detection timer T2 has timed out,touch release information is transmitted to the display device DS, sothat the non-touch detection timer T2 is set into a stopped state.

In step S3, the communication section 23 checks whether displayinformation that is transmitted from the display device DS is received.As described above, the display information is information including asub-screen position 35 and near-field region information 36. In a casewhere the display information is received in step S4, the processproceeds to step S5, and in a case where the display information is notreceived in step S4, the process proceeds to step S6. In step S5, thedisplay information acquisition section 24 acquires the sub-screenposition 35 and the near-field region information 36 from the displayinformation thus received and stores them in the storage section 30.This allows the touch panel TP to recognize the display position andsize of the sub-screen PIP currently displayed on the display device DSand the position and size of the near-field region.

In step S6, the touch detection section 25 checks the presence orabsence of a touch on the touch panel TP. In a case where there is atouch on the touch panel TP in step S7, the process proceeds to step S8,and in a case where there is no touch on the touch panel TP in step S7,the process proceeds to step S21 of FIG. 13.

In step S8, the input control section 21 acquires information on thecoordinates of the touched position. In step S9, the touch informationtransmission section 22 transmits the information on the coordinates ofthe touched position to the information processing device PC. In stepS10, the non-touch detection timer T2 is set to the initial value ofmeasurement time and activated.

In step S11, a check is made to determine whether the touch storageinterval timer T1 is in a time-out state. In a case where the touchstorage interval timer T1 has timed out, the process proceeds to stepS12, and in a case where the touch storage interval timer T1 has nottimed out, the process proceeds to step S14. In step S12, the touchedposition coordinate information thus acquired is stored in the touchhistory information 31. In step S13, the touch storage interval timer T1is set to the initial value of measuring time and activated.

In step S14, the touch position determination section 26 checks whetherthe position touched is in a near-field region indicated by thenear-field region 36 stored. In a case where, in step S15, the touchedposition is in the near-field region, the process proceeds to step S16,and in a case where, in step S15, the touched position is not in thenear-field region, the process returns to step S3.

In step S16, the display position determination section 27 createsreduction information by performing a reduction determination process onthe display region of the sub-screen PIP. In this step, the touchhistory information 31 stored in utilized to, as shown in FIGS. 7A to7C, FIGS. 8A and 8B, and FIGS. 9A and 9B, determine a display region ina case of reducing the sub-screen PIP and create reduction information.The reduction information is information pertaining to the displayposition and near-field region of the sub-screen PIP after reduction.

In step S17, the display position determination section 27 createsmovement information by performing a movement determination process onthe display region of the sub-screen PIP. In this step, the touchhistory information 31 stored in utilized to, as shown in FIGS. 10A to10C and FIGS. 11A and 11B, determine a display region in a case ofmoving the sub-screen PIP and create movement information. The movementinformation is information pertaining to the display position andnear-field region of the sub-screen PIP after movement.

In step S18, the reduction information notification section 28 and themovement information notification section 29 transmit the reductioninformation and movement information thus created to the display deviceDS, respectively. After that, the process returns to step S3 and thesame process is repeated.

In step S21 of FIG. 13, a check is made to determine whether thenon-touch detection timer T2 is in a stopped state. In a case where thenon-touch detection timer T2 is not in a stopped state, the processproceeds to step S22, and in a case where the non-touch detection timerT2 is in a stopped state, the process returns to step S3 of FIG. 12A. Instep S22, a check is made to determine whether the non-touch detectiontimer T2 is in a time-out state. In a case where the non-touch detectiontimer T2 is not in a time-out state, the process proceeds to step S23,and in a case where the non-touch detection timer T2 is not in atime-out state, the process returns to step S3 of FIG. 12A.

In step S23, since the continuation of the non-touch state of a touchfor a predetermined period of time or longer has been detected, touchrelease information indicating that a touch release (touch-up) hasoccurred is transmitted to the display device DS. In step S24, thenon-touch detection timer T2 is set into a stopped state. In step S25,the touch storage interval timer T1 is set into a time-out state. Afterthat, the process returns to step S3 of FIG. 12A and the same process isrepeated.

Thus, in a case where touched positions are acquired and stored as thetouch history information 31 at regular intervals and it is determinedthat a touched position is in the near-field region of the sub-screenPIP, the touch history information 31 is utilized to perform a reductiondetermination process and a movement determination process to determinethe position and size to which the sub-screen PIP should be reduced andthe position to which the sub-screen PIP should be moved, and reductioninformation and movement information are notified to the display deviceDS. With this, in a case where the touch history approaches thesub-screen PIP, the position to which the sub-screen PIP should bereduced in a case where it is reduced and the position to which thesub-screen PIP should be moved are notified to the display device DS, sothat a reduction or movement of the sub-screen PIP is executed in thedisplay device DS. Therefore, even without performing a specialoperation except for touch input with an input pen, the user cancontinue the input without the sub-screen PIP constituting an obstacleto the input operation.

Process of Reducing and Moving Sub-Screen Through Information DisplayDevice

FIGS. 14A and 14B are flow charts of a process of, for example, reducinga sub-screen through the information display device according to theembodiment of the present disclosure.

Assume here that a user performs a predetermined input operation with aremote controller or the like to transmit, to the display device DS, arequest to display a sub-screen PIP in a part of the main screen MD. Ina case where reduction information and movement information have beentransmitted from the touch panel TP while a sub-screen PIP is beingdisplayed on the display device DS, the sub-screen PIP is reduced on thebasis of the reduction information first and, in a case where thesub-screen PIP has already been reduced, the sub-screen PIP is moved onthe basis of the movement information. Further, in a case where a touchrelease (touch-up) has occurred, the display position of the sub-screenPIP is returned to the initial position.

In step S41, the display control section 51 displays a predeterminedimage on the first display screen (main screen MD) of the display panel52. This image is for example an image that is generated by the imageprocessing section 55 on the basis of an image signal that is suppliedfrom the information processing device PC and inputted from the imageinput section 54.

In step S42, the display control section 51 checks whether, as a resultof the user's predetermined input operation, there is a request todisplay a sub-screen PIP. A request to display a sub-screen PIP includesinformation pertaining to the display position and size of thesub-screen PIP and image data to be displayed on the sub-screen PIP. Ina case where a request to display a sub-screen PIP has been received,the process proceeds to step S43, and in a case where no request todisplay a sub-screen PIP has been received, the process returns to stepS41.

In step S43, the display position (initial position information 61) ofthe sub-screen PIP is stored in the storage section 60. In step S44, theinitial position information 61 of the sub-screen PIP is utilized to seta near-field region NF of the sub-screen PIP, and the near-field regionNF is stored as near-field region information 64 in the storage section60. In step S45, the display control section 51 displays the sub-screenPIP on the display panel 52. The current display position of thesub-screen PIP thus displayed in stored as a sub-screen position 63 inthe storage section 60. The sub-screen position 63 and the near-fieldregion information 64 are equivalent to display information 62.

In step S46, a reduction mode flag is set to OFF (yet to be reduced).The reduction mode flag is information that indicates whether thesub-screen PIP has ever been reduced. For example, in a case where thesub-screen PIP has been reduced, information indicating ON (reduced) isset, and in a case where the sub-screen PIP has not been reduced yet,information indicating OFF (yet to be reduced) is set.

In step S47, the communication section 56 transmits the displayinformation 62 thus stored to the touch panel TP. In this step, thesub-screen position 63, which is equivalent to the initial positioninformation 61 of the sub-screen PIP, and the near-field regioninformation 64 are transmitted to the touch panel TP. In step S48, acheck is made to determine whether touch release information has beenreceived from the touch panel TP. In a case where touch releaseinformation has been received, the process proceeds to step S56, and ina case where no touch release information is received, the processproceeds to step S49.

In step S49, a check is made to determine whether the display positionacquisition section 57 has received reduction information and movementinformation from the touch panel TP. In a case where reductioninformation and movement information have been received, the processproceeds to step S50, in which the reduction information and movementinformation thus received are stored as display position acquisitioninformation 65 in the storage section 60. On the other hand, in a casewhere no reduction information or movement information is received, theprocess returns to step S48. In step S51, a check is made to determinewhether the reduction mode flag is ON (reduced). In a case where thereduction mode flag is ON (reduced), the process proceeds to step S52,and in a case where the reduction mode flag is OFF (yet to be reduced),the process proceeds to step S54.

In step S52, since the reduction mode flag is ON (reduced) and thesub-screen PIP has already been reduced, the movement process section 59moves the sub-screen PIP on the basis of the movement information thusreceived and displays the sub-screen PIP. In step S53, displayinformation 62 including the display position 63 of the sub-screen PIPafter movement and near-field region information 64 is stored in thestorage section 60. After that, the process proceeds to step S60, inwhich the display information 62 thus stored is transmitted to the touchpanel TP. After that, the process returns to step S48 and the sameprocess is repeated.

In step S54, since the reduction mode flag is OFF (yet to be reduced)and the sub-screen PIP has not been reduced yet, the reduction processsection 58 reduces the sub-screen PIP on the basis of the reductioninformation thus received and displays the sub-screen PIP. In step S55,display information 62 including the display position 63 of thesub-screen PIP after reduction and near-field region information 64 isstored in the storage section 60. In step S56, the reduction mode flagis set to ON (reduced). After that, the process proceeds to step S60, inwhich the display information 62 thus stored is transmitted to the touchpanel TP. After that, the process returns to step S48 and the sameprocess is repeated.

In step S57, since the touch release information has been received, thesub-screen PIP is returned to the initial display state. That is, thesub-screen PIP is displayed on the basis of the stored initial positioninformation 61 of the sub-screen PIP. In step S58, display information62 including the display position 63 of the sub-screen PIP returned tothe initial display state and near-field region information 64 is storedin the storage section 60. In step S59, the reduction mode flag is setto OFF (yet to be reduced). After that, the process proceeds to stepS60, in which the display information 62 thus stored is transmitted tothe touch panel TP. After that, the process returns to step S48 and thesame process is repeated.

Modifications

Modification 1

The embodiment described above has mainly shown one in which smoothcontinuation of touch input on the main screen MD withoutdiscontinuation of a user's touch input operation is allowed by movingthe second display screen (sub-screen PIP) after having reduced thesub-screen PIP.

Note, however, the embodiment described above does not imply anylimitation, provided smooth continuation of touch input on the mainscreen MD is allowed even while the sub-screen PIP is being displayed.

For example, the sub-screen PIP may be made gradually smaller byperforming only a gradual reduction process more than once.Alternatively, a movement process may be first performed after thesub-screen PIP has been reduced at the maximum reduction ratio set inadvance. Alternatively, the sub-screen PIP may be moved first and thenbe reduced in the position to which it has been moved.

Furthermore, a reduction process and a movement process may bealternately performed on the sub-screen PIP more than once, andregardless of the order of a reduction process and a movement process, aplurality of reduction processes and a plurality of movement processesmay be combined as appropriate. Further, while the settings may beconfigured in advance as to which processing method to utilize as themethod for processing a sub-screen PIP, the user may be allowed tofreely configure the settings for the processing method to be used.

Modification 2

Although the embodiment described above has shown an embodiment in whichthe sub-screen PIP is first reduced and then moved, this is not the onlyprocess that is performed on the sub-screen PIP. The process may becombined with a process of making the sub-screen PIP transparent bylightening the display color of the sub-screen PIP and a process oftemporarily erasing the sub-screen PIP. For example, the reductionprocess, the movement process, the transparency process, and thetemporary erasure process may be performed in this order.

Modification 3

Although the flow charts shown in FIGS. 12A and 12B, FIG. 13, and FIGS.14A and 14B of the embodiment described above have shown one in whichafter the touch panel TP has determined a position of reduction and aposition of movement, the touch panel TP transmits both the position ofreduction and the position of movement to the display device DS and thedisplay device DS performs a reduction process first and then performs amovement process, this does not imply any limitation.

For example, in a case where the touch panel TP has determined which ofthe reduction process and the movement process is performed and hasdetermined that the reduction process is performed, the touch panel TPtransmits only information on the position of reduction to the displaydevice DS. On the other hand, in a case where the touch panel TP hasdetermined that the movement process is performed, the touch panel TPtransmits only information on the position of movement to the displaydevice DS and the display device DS needs only perform the reductionprocess or the movement process on the basis of the received informationon the position of reduction or the received information on the positionof movement.

Modification 4

Although the embodiment described above has shown one in which, sincethe sub-screen PIP is first reduced and then moved, the size of thesub-screen PIP after movement is the same as the size of the sub-screenPIP after reduction as shown in FIG. 6B, this does not imply anylimitation.

For example, the size of the sub-screen PIP after movement may bereturned to the same size as that in which the sub-screen PIP wasdisplayed in the initial position. Further, the size of the sub-screenPIP after movement may be adjusted in view of an image or the likesurrounding the display position of the sub-screen PIP after movement.

Modification 5

Although the embodiment described above has shown one in which the firstdisplay screen (main screen MD) is segmented into four segmented regionsand the sub-screen PIP is displayed in any of the four segmentedregions, this does not imply any limitation. For example, it is possibleto set the number n of segmented regions at 5 or larger, utilize thetouch history information to extract such a segmented region from amongthe n (>4) segmented regions as to allow smooth continuation of touchinput, and move the sub-screen PIP to the segmented region thusextracted.

Modification 6

The embodiment described above has shown one in which the sub-screen PIPis returned to the initial display state in a case where there has beenno touch input for a predetermined period of time or longer. Note,however, that when the sub-screen PIP is returned to the initial displaystate, there is a case where a line segment or an image has already beendisplayed by touch input in the initial display position of thesub-screen PIP. In this case, as a method for returning the sub-screenPIP to the initial display state, any of the following measures needonly be taken, for example.

First, even if a line segment or an image has already been displayed inthe initial display position of the sub-screen PIP, the sub-screen PIPis displayed over the line segment or the like. Further, in a casewhere, if the sub-screen PIP is returned to the initial displayposition, the sub-screen PIP overlaps the line segment or the imagealready inputted by touch, a warning display or a warning sound may beused prior to the returning of the sub-screen PIP to the initial displaystate to notify the user that there is a line segment or the like thatthe sub-screen PIP overlaps.

After that, in a case where there is input from the user meaning thatthe returning of the sub-screen PIP to the initial display state is notpermitted, the sub-screen PIP is not returned to the initial displaystate. On the other hand, in a case where there is input from the usermeaning that the returning of the sub-screen PIP to the initial displaystate is permitted, the sub-screen PIP needs only be returned to theinitial display state.

Further, in a case where, if the sub-screen PIP is returned to theinitial display position, the sub-screen PIP overlaps the line segmentor the image already inputted by touch and in a case where a region inwhich the sub-screen PIP of the size in the initial display state doesnot overlap information displayed on the main screen MD is present onthe main screen MD, the sub-screen PIP may be moved to the region.Further, the sub-screen PIP may be returned to the initial display stateonly in a case where, if the sub-screen PIP is returned to the initialdisplay position, the sub-screen PIP does not overlap the line segmentor the image already inputted by touch.

The present disclosure contains subject matter related to that disclosedin Japanese Priority Patent Application JP 2017-057501 filed in theJapan Patent Office on Mar. 23, 2017, the entire contents of which arehereby incorporated by reference.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

1. A display apparatus with an input function, comprising: a positioninput device through which to input information on a touched position;and a information display device that displays information, the positioninput device and the information display device being placed on top ofeach other, wherein the information display device includes a displaypanel that displays a first display screen and displays a second displayscreen in a display region of the first display screen, and a movementprocess section that moves the second display screen, the position inputdevice includes a touch detection section that acquires the informationon the touched position in handwriting input, a second storage sectionstoring touch history information including information on a pluralityof the touched positions thus acquired, and a display positiondetermination section that, in a case where the touched positiondetermination section has determined that the touched position of anewly-acquired handwriting input is present in a near-field region,utilizes the touch history information is determine position to whichthe second display screen is moved.
 2. The display apparatus with aninput function according to claim 1, wherein the information displaydevice further includes a first storage section storing displayinformation including a display position of the second display screenand information on the near-field region including the second displayscreen and having a larger region than the second display screen, andfirst communication section that transmits the display informationstored in the first storage section to the position input device, theposition input device includes a second communication section thatreceives the display information, and the second communication sectiontransmits, to the information display device, the information on theposition at which the second display screen determined by the displayposition determination section moves.
 3. The display apparatus with aninput function according to claim 1, wherein the position input deviceacquires the position of the second display screen included in thedisplay information received from the display device and information ofthe near area, and stores the information, in the second storagesection.
 4. The display apparatus with an input function according toclaim 1, wherein the display position determination section predicts,from the information on the touched positions included in the touchhistory information, a direction of travel of a position that is to betouched at a future time and determines, as the position to which thesecond display screen is moved, a position that is out of the directionof travel of the touched position.
 5. The display apparatus with aninput function according to claim 1, wherein in a case where the displayposition determination section has confirmed, with reference to theinformation on the touched positions included in the touch historyinformation, that the display region of the first screen includes aregion that has not been touched until a present time since a touch wasstarted, the display position determination section determines, as theposition to which the second display screen is moved, the region thathas not been touched.
 6. The display apparatus with an input functionaccording to claim 1, wherein the display position determination sectiondetermines the area having the oldest touched time as a position to movethe second display screen, when there is no area that has never beentouched since the start of the touch, by using information on aplurality of touch positions included in the touch history information.7. The display apparatus with an input function according to claim 1,wherein the near-field region is a region that has, around a displayregion of the second display screen, a width that is larger by apredetermined distance.
 8. The display apparatus with an input functionaccording to claim 1, wherein the first storage section stores initialdisplay position information indicating a display position in which thesecond display screen was first displayed, and in a case where the touchdetection section has not acquired information on a touched position fora predetermined period of time or longer since the second display screenwas reduced or moved, the initial display position information isutilized to return the second display screen to the display position inwhich the second screen was first displayed.